منابع مشابه
A Partially Observed Markov Decision Process for Dynamic Pricing
In this paper, we develop a stylized partially observed Markov decision process (POMDP) framework, to study a dynamic pricing problem faced by sellers of fashion-like goods. We consider a retailer that plans to sell a given stock of items during a finite sales season. The objective of the retailer is to dynamically price the product in a way that maximizes expected revenues. Our model brings to...
متن کاملInference for a class of partially observed point process models
This paper presents a simulation-based framework for sequential inference from partially and discretely observed point process models with static parameters. Taking on a Bayesian perspective for the static parameters, we build upon sequential Monte Carlo methods, investigating the problems of performing sequential filtering and smoothing in complex examples, where current methods often fail. We...
متن کاملOn Functionals of a Marked Poisson Process Observed by a Renewal Process
We study the functionals of a Poisson marked process Π observed by a renewal process. A sequence of observations continues until Π crosses some fixed level at one of the observation epochs (the first passage time). In various stochastic models applications (such as queueing with N-policy combined with multiple vacations), it is necessary to operate with the value of Π prior to the first passage...
متن کاملPartially Observed Markov Decision Process Multiarmed Bandits - Structural Results
This paper considers multiarmed bandit problems involving partially observed Markov decision processes (POMDPs). We show how the Gittins index for the optimal scheduling policy can be computed by a value iteration algorithm on each process, thereby considerably simplifying the computational cost. A suboptimal value iteration algorithm based on Lovejoy’s approximation is presented. We then show ...
متن کاملFractional Poisson Process
For almost two centuries, Poisson process with memoryless property of corresponding exponential distribution served as the simplest, and yet one of the most important stochastic models. On the other hand, there are many processes that exhibit long memory (e.g., network traffic and other complex systems). It would be useful if one could generalize the standard Poisson process to include these p...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Stochastic Processes and their Applications
سال: 1982
ISSN: 0304-4149
DOI: 10.1016/0304-4149(82)90047-3